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Preface 

The Artificial intelligence Laboratory proposes to continue its work on 
a group of closely Interconnected projects, all bearing on questions 
about how to make computers able to use more sophisticated kinds of 
knowledge to solve difficult problems. This proposal explains what we 
expect to come of this work, and why it seems to us the most profitable 
direction for research at this time. 

The core of this proposal is about well-defined specific tasks such as 
extending the computer's ability to understand Information presented as 
visual scenes-^or In natural, human language. Although these specific 
goals are Important enough In themselves, we see their pursuit also as 
tightly bound to the development of a general theory of the computations 
needed to produce intelligent processes. Obviously, a certain amount of 
theory Is needed: to achieve progress In this and we maintain that the 
steps toward a deep theory In this domain must include thorough analysis 
of very soeclftc phenomena. Our confidence in this strategy is based 
both on past successes and on cur current theory of knowledge structure. 
These bases are discussed both below and In the appendices. 



T -0 give a clearer Idee of this position, wr contrast our 51 re te gy with 3 
number of questions typical of an earlier phase of think inf. about 
Artificial Intol! F ze nee {end which are still often po s ed b y oy 1 5 T d e r s): 


You seem to be making "performance" programs for certain particular 
jobs. Why do you concentrate on "specialist" programs like 
VI $! OfJ and the l] LOCKS Wflfll-D, that deal wTth such narrowly 
restricted kinds of objects? 

Why don’t you do more work on learning-? Aren't you building, too 
much of the solutions Trto your programs, instead of retting 
them to adapt themselves to new situations? 

Why don't you pursue more ''general 1 ' problem solving, methods? Are 
you usTng the right kinds of computers? Shouldn't you model 
the brain more closely? 

Our answers to such Issues are all tied closely together- Of course we 
want to> develop programs with very broad powers. But finding how to do 
this Involves the usual paradoxical strategy of Science: the keys to 
"generalTLy" often lie In understand! ng thoroughly certain Issues that 
are best studied in special situations in which the issues are 
particularly clear. we believe that f&r us the most central such issue 
Fs this: how can wo exploit diverse kinds of knowledge In the same 
process ? 


The art of computer programming has developed along lines 
very narrow Jr this regard- Each kind of "subroutine", ir 
traditional programming, expects to get Information In one 
specific format, "data type", or structure. Two processes 
operating at different "levels 1 ' then cannot communicate 
directly. The trarfitioral solution Fs to organize alt 
complicated programs into a serlps of stages or "passes" in 
which t^e data-tyees change sharply and irrevocably. 
Unfortunately* as we and others have found, this 1$ 
Incompatible with many Important FntelIIgence-Iike 
processes. 



Our proposed solutions are &t It 1 evolving, but they all seem to turn 
around new methods of program! Ins and mew wavs to represent knowledge 
about programming. The field of Artificial Intelligence has made 
enomous progress in the past few years toward br-comlng a scientific 
subject, Among Its most powerfully productive pa rad I pms are? 

Learning Structural Descriptions 
Heterarchical Programming 
Knowledge about Procedures 
Procedural Embedding 

In our proposals for the oast two years, we explained why we see these 
as Important and how we plan to develop them, We append the central 
port Tors to this proposal, as appendices. Readers who have followed Al 
closely should have no difficulty with the language of those 

expositions, but readers unfamiliar with the jargon of this field would 
do better to begin with our book-*! ength report A.I. MEMO 252, a general 
Introduction to the role of our work in relation to other sciences 
concerned with thinking and Intelligence, The central part of thFs 

proposal will spell out the state of the particular projects to which 
those general ideas are applied in our Laboratory, 

For some years, we have been developing these new methods 'arpely Fn the 
Context of two tl nl cro-worl ds 11 , the VISION SYSTEM and the BLOCKS WORLD, 
Within these models we now can went on sophisticated tecbnicues for 
learning, as well as on the new styles of programming, tfh E1 e both of 
these older worlds are very specEa1tzed Tn a number of ways, a third 



dnrra F n rs now beginning to crystallize; It Isa more grreraT, common- 
j&nse domain of discourse in which onp can discuss many evr-ryday 
concepts we are sure must be Involved in n thoughtf ul 11 act r v I ty^-such 
matters as time, purpose, planning, simple economics, need for 

knowledge, etc. 


GOALS and APPLfGATlQNS 

The rent few sections are about our main goals, both for long-range 
research and for particular application areas. The general technical 
position of our 19711 prrl 1971 proposals still represents the direction 
of our approach. however, although those proposals are relatively 
explicit about the hrgh-Ievel problems motivating our research, they do 
not give a very clear picture of the actual projects, or of their 
practical eonseauences. in this proposal wr shall concentrate on giving 
a more concrete view of our Immediate goals* The next four sections are 
each directed to an "area” of application. It will be obvious that the 
concepts and methods uSEd in those areas are closely related, Our 
Intentions about the applications vary, naturally. In some cases we 
have major efforts toward completing effective operatFonsT prototypes. 

In the rest, we expect to produce demonstration prototypes, or only to 
develop some theory, clarify problems, and attempt to direct the 
attention of others to problems which we think need immediate attention. 
Some projects arc I ini tec? because we don * t yet know how to proceed 
faster, others are limited simply by the size of the project staff, or 



by no* lonppr adequate hardware. 


arfa i: Ronanrs, vision, autcmati on 

AUTOMATION and PnODUfTU 1 1 TV: 

F.v?r. in Its current early stage of development, Al is reedy for 
application in eary practical areas such as Industrial assembly, 
fabrication., inspection, m* T n i p p, medicine, undersea and space 
ruploration, and agriculture, Although we are rot directly active 
In these areas, the Al Lab makes efforts to Inform* individuals and 
a/tone ins who might be so involved. The United States has not 
addressed the problem of general product t v I ty with the imagiretI or 
and energy approprIPte and necessary to meet future reeds. The 
Laboratory has probably bad a targe effect Fr drevrlrg attention to 
this situation and the past yean has Seen a substantial growth of 
concern with this area* ir government and Industry, 

In conjunction with rie ve I upmen t of the mini^robots we plan to work 

toward e demonstration of Its applicability to automation. The target. 

application Ts not yet settled; the front runner Ts automated assembly, 

inspection, and testing of very small computer processors, built of 

microelectronic components. This choice of application might stem a 

little ^inbred"; the main factor is simply that the microelectronic 

Industry Is the only one really concerned today with very small 

assemblies. He are still open to suggestions about other applications. 


RhP-nncS: 

We would like to see much rore sophisticated computer controlled 
effectors become available for practical application as wp Ii as for 
research, Thera has been much too little development in the field 
of mechanical manlnuSators. Even though there are perhaps £■[) 
cot-iretinr " i ndustr 1 al robots" In production today, they are all 
astonishingly uniform in their primitive articulation. Hone have 
but the most r u d 3mentary feedback facilities. Although it wou1d be 
a serious diversion to try to make our Laboratory Into a center For 
general development of reliable mechanical hardware, we and the 
other A^FA projects are playing b critical role in drafting 
prototypes and stimulating rational activity in that area. 



In pert Icul ar, D* Silver Is now debufipEfR a force-feedback systpm that 
uses strain measurements \r the man!potator*s wrist. This appears to be 
extremely effective for practical matters, es a compromise between 
elaborate touch sensors (that are hard to relate to taryer-scale forces) 
and motor-load feedback systems (which In principle frfnrir about local 
forces but are impractical Er practice because of the very poor 
sIgna1/noEse ratio one has after subtracting out gravity and Tnertfai 
terms for the whole moving mass). 


COMPUTER VISION; 

Out long-range goal fs to discover how to moke machines able to 
look out at the world and "ste". This plays such a largo role in 
our previous work that we will not review ft at thfs point, except 
to note that this goal involves major developments in areas often 
called 11 percept for" and "pattern recogn 1 t f on". We maintain that 
good performance Tn non-trlvlal visTon problems requires systems 
that rpally understand e lot about what they are looking at, and 
the kind of fundamental research on knowledge that we are doing can 
not be side-stepped. 

The MIT VISION SYSTEM Is, at present, st1U an experimental prototype 

developed to explore new Ideas both about machine vision and new styles 

of programming. It Is the most powerful system available within its 

narrow domain of analysing monocular, polyhedral scenes. We are 

extending its capabilities to deal with more natural objects. Up to 

now, this system could deal only with polyhedral objects having uniform 

plane surfaces, such as blocks, wedges, pyramids and the 1 ike, but 

(1} Vie are now working on processing and description of textured 
surfaces k 

(2) More global object-efescrTpt ions are being studied, using a 
scheme of Mollerbach that starts with basic shapes and 
describes local deviations from It; we expect to be able to 
extend these to non-planar objects, 
f3) The new syst pm will be able to deal with mo tion and use It for 



visual purposes In app 1 i ca t F ons such as pouring liquids. 

{ U J We art beg i np I ng to comb F ne visual, tactile and force feedback, 
and plan to demonstrate 3 significant; automatic assembly 
application., using the new mi nf^ robot hardware* 

ire hope to show that the soph T st t cat Ion developed over the years in our 

heterarcM ca 3 vision system v . 1 111 lead to a system able to deal with 

seeing real situations like that Tn a regular tool box. Although the 

problems Tn a realistic environment will be more complex, we expect many 

principles to carry over from our present system* Among those 

orincipies; 

the best methods for "low level” scene analysis lean toward 
relatively si mole low level filters guided by larre amounts of 
kr.owl edge about the objects. 

threat power derives from the use of a firm theory of the semantics 
of boundaries to rapidly classify lines as shadows, cracks, concave 
or convex edges, etc, Better results come from using higher level 
knowledge than from attempting to push the use of local opt Tea 3 
cues beyond meaningful limits. 

We know a good deal about building descriptions in terms of geometric 
and optical relations between objects, ways to hypothesize objects from 
partial presentations and ways to propose groupings and using the groups 
to aid analysis. ft remains to be seen bow smoothly this experience car 
be transferred from the old BLOCKS WORLD to the realistic scene world* 


MINI-ROBOT I 0$1 

We have a particular interest in developing laboratory equipment 
for robot 1 os research on a very small physical scale. We have two 
reasons for this. First, there are Important applications for a 
mechanical '"microtechnology” that does not now exist, yet there Is 
no serious technical limitation deterring it* These applications 
range from involving fabrication ar-d ^setnbly of physically small 
but complicated systems to new applications in medicine, 
agriculture, and space that are generally unrecognised at present. 
For details, see our proposal to JVRfA about MI crotechno 3 ogy. 
Second, we fed that there fs now a sturdy backlog of good ideas 



for advanced automation that ire developing very slowly only 
because ft is hard for people to set up research laboratories 3r 
this field. This project Is an opport lip i t y for our Laboratory to 
simplify and modernize Its own equipment and, at the samp time, 
produce an easily-copied system that we hope will H^v? 3 
substantial effect In sppeding up progress in other tenters, 

VJe emphasfie that the sire scale involved fn our mini “robot project Ts 

MOT so small as to require major engineering innovations. The devices 

win work within a space of a few Fnches* with accuracy on the order of 

,001 lnchj which is a modest precision in machine tool practice, We 

expect the system to be able to handle tasks on an order of magnitude 

smaller than does current equipment, without creating very serious new 

design complications, 

AR£A fit Knowledge 

"The trouble with computers Ts 

Everyone has his own complaint, deriving From some collection of bad 

pxperIencest The computer is too literal; you have to tell It about 

every possible situation, and oven then it will manage to find some 

misinterpretation. Another way to put Ft Fs to say that today’s 

computers have no "common sense". For example, in the BLOCKS WORLD, we 

have tc write explicitly into the program something that says not to try 

to put two blocks in the same place. Less trivial: 

If- there fs a statement that "block, 1 1$ on hlock 2", and 
some action moves block I, then that statement should he 
removed, 



To do this explicitly for all kinds of statements leads to srrious 
problems, because tome such statements concern others, t'e need a morn 
penerat method, Not too general, of course; If .an action causes block 1 
to be painted 1 red, we don't wont the action of moving it to make the 
machine think ft wl M become green again! Solution; the machine should 
know that "geometric 1 ' aspects like "above 1 ', "parallel to", "to the left 
of" transform In certain ways, while '‘surface 111 properties like "green 1 ', 
"rough", "sticky", transform In other ways. These are things that 
"every child k n ow s 11 . 

Even In situations that seem very simple to people, behaving In a 
"sensible" fashion requires knowing a lot about many different kinds cf 
things, 1p one way or another, every facet of our Laboratory is 
concerned with such Issues, as are the other Al laboratories* 

Ordinarily, In each particular problem area, one accumulates more and 
more "ad hoc" techniques that improve competence. Unfortunately, this 
kind of experfence doesn't seem to lead to general Insights, 

Formulating the theoretical issues Is Critical If we are to make sense 

of the whole area and discover practical methods for handling rea1 world 
problems. The Issues can be formulated along a number of dimensions; 

UROAb vs * DFEPd 

Most workers seem to believe that common sense reasoning is fairly 
’’shallow" in the sense that if the process were represented as a 
logical deduction process the "proofs" would not be very long. 

Even sc, finding a proof with just 10 steps woul d pose a terrible 
search problem, because ft Is dear that the basis for common sense 
reasoning must contain many thousands of Items, Th e- problem, then. 
Is more one of finding a mechanism for determining "relevance" than 



find IfiK ore for deduction. Su-ch a mechanism would depend, 
presumabi y, on bu I 1 d T n e; a C 1 as s | f 1 eg tor y Structure for how 
different kinds of knowledge interact* 

IrpEPEMDEtfCE: 

How dues one add now 3 n f o rma 13 on to the system? In ofif idea], all 
Information Is expressed In the form of compact "decl arat f vp" 
statements; "broken glass Fs sharp”; "powers of a group rlcmpnt 
form cyclTe sobyroups", etc. Fn the "theorem-nrovFng" approach to 
reasoning, all the Information Is so represented on the same level, 
as '"axioms”, and new Information Is added sirrnly by adding another 
axForff, 

This Ideal leads, unfortunately, to some serfous difficulties. One 
really cannot use ’’facts 11 unless they are accompanied by Informat Fon 
about how to use them. Some facts serve to warn against using other 
facts for certain jobs. A person's most Important kind of Informatlor, 
perhaps. Is about thinking Itself; how to break a problem Fnto subgoals, 
deciding v.'hen certain kinds of analogies are appropriate, when certain 
fcfnds of plans are realistic, etc* We don't know enough, yet, about how 
to represent Information about such matters, Findependent of particular 
application areas, and this makes problems for the theorem-proving 
approach, 


PKGrFDURAl vs* DECLARATIVE; 

These problems seem at first not nufte so difficult when one 
considers embedding knowledge in the form of procedures. A warning 
about a certain '’fact” becoming undependable In some kind of 
situation can be embodied by programming an appropriate test at the 
right place In the pro fa!errmsolving program. Gut this only raises 
other, equally hard problems. Embedded in a procedure, the meaning 
of an assertion can become oependgnt on its local context to such a 
degree that inserting more knowledge becomes very Hard. in the 
declarative system this problem of local dependence 1$ not so 
acute, but It Is only an Illusion to think that It can be made to 
disappear effectively. For even in the axiomatic systems, the 
moaning of a term depends on other assertions using that symbol, 
and the interactions can become badly dispersed; one suddenly sees 
the local dependence as a lost advantage instead of as a nuisance* 



An l ntermed Fate kind of syst ere --the 1 * p r od u c t i o n 11 o ^ our col lea purs 
at CMU--hes many problems of Its own; the effects of items tiro 
influenced largely by their neighbors, they have some degree of 
Independence, but ft is hard to see how they can apply to one 
another In ways that would be useful for planning. 

This ?s an area of intense intellectual activity today* with very 

d f verse viewpoints. Pur plan is not to attempt yet to decide which 

approach Is best* for each has Important elements, hut to attempt to 

extend our mlcrowoflds in several different ways to find what are the 

Important problems and phenomena. 


NATURAL LANGUAGE: 

Work is continuing on various extensions of SHRPLU, Vfino grad *s 
language understanding system. The availability of this system 
over the ARpA network* in a well documented verst no at CMLJ* will 
permit faster progress Fn developing techniques for introducing new 
concepts* Unfortunately* our own computer system Ts too overloaded 
to make the facility available to many outsiders, and It will no 
doubt load the other systems rather heavily, as well, 

Work on language wMl continue to develop both theory and 
extensions of current capabilities* A variety of seminars arc- 
directed toward a deeper understanding of the processes involved in 
language understanding, with one goal^-that of deftning the 
directions for a "next generation” language understanding program, 

A number of students are working on aspects of syntax and 
semantics, such as the problems of ouar-tlfTer scope* the addition 
of a wirier range of syntactic constructions to the previously 

developed grarrmar, the Fssues raised by simple sorts of language 
translation and the problems of generating complex syntactic 
Structures from a semantic base,. Drew McDermott (see below) Ts 
writing a program which will mpke the sort of plausible Tfiferente£ 
necessary for understanding language In context. This ts being 
done in conjunction with the development of the CONNfVER language 
as a formalism for representing and manipulating kno-w ledge. His 
program follows a narrative of a simple series of events, trying to 
dravr causal connections between them end making predictions about 
what it expects to happen. 

Several things are helny done to make the earlier work (see last 
yea r T 5 progress report) more useful to o t he- r people, Some of them 
ere being dorr in corj ynctinn with the Project MAC automatic 
p rogr pmirl r g group ar-rl the At project at Ca meg f e ^Me 1 1 on, They 



involve providing easier ^ays to Interface programs with new data 
areas, a user-engineered front end enabling people to run the 
programs and Interrogate them through the use of a sin-pie command 
tree, improved documentation and other descriptive material such es 
flow charts of the grammar, 

UNDERSTAND! HP .NARRATi VE s 

fn his recent thesis, Eugene fharplak proposes a technique for 
handling many aspects of common sense In connection with 
Underscandlng narrative, A narrative is a sequence of statements 
describing a sequence of events, understandable by a person, but 
which usually contains a near minimum of detail, A great deal of 
material must be filled In by the reader, using his own store of 
general knowledge, to convert a narrative to a step-like chain of 
statements that say everything explicitly. Cherniak sketches out a 
sequence of stages of analysis for each sentence that may result in 
filling In many such details. These mechanisms are supposed to 
help resolve ambiguities, determine unspecified references, propose 
motivations for actions and generally act as Information retrieval 
and plausible explanatlon devices. 

Cbarnlak t $ central mechanisms Involve setting up procedures called 

‘"demons’ 1 . These are essentially PLANNER antecedent statements that are 

set up by local contexts and then persist, actively "watching" for 

statements that might signify the occurrence of certain activities that 

particularly concern the demon. For example, when a mathematical 

subject Ts mentioned, the System could set up a demon that monitors the 

subsequent text for ordinary words that happen to have special 

mathematical signif|cance, so that meanings would bo considered that 

would have a very low rate of occurrence in ordinary text. 


Last year’s proposal mentioned plans for this system. It has changed 
and developed substantially and the thesis will be available soon as a 
report. There does not yet exist an operational system for exploring 
the advantages and limitations of this rdea and constructing one will 
depend on recruiting capable workers for that project. 



UHfiFRSTANOim NARRATIVE, h 

WhMe Cherniak'# yiorl; applies to a world that mculrea a very wldr 
knowledrr bsse-'lt Is the world of things a first-grade child must 
know to understand his reading books, Drew McDermott is attempting 
a system that attacks the same general kind of problem In a less 
local way, by attacking a problem of narrower scope but greeter 
logical depth* Charnlak's system can be viewed as an experiment to 
See how far one can go In filling In narrative details by setting 
up predictions whenever possible to embody what one already knows 
or might r ea sona b 1 y ex pe c t about the # ! t u $ tior. * These ex pec tat f o n 5 
operate on a very wide range of subject matter but they have no 
general mechanisms for dealing with complicated interactions, 
McDermott*? model operates In a much more restricted domain-'sn 
extension of Wl no grad’s SLOCKS WO RID, which now contains an actor 
wTth his own motivations and knowledge* Again, the system has to 

generate a hypothetical scenario to be consistent with a narrative. 
The system must deal with different kinds of causality* decide 
which kinds of explanations would be adequate for an actor who Ha# 
Specific items of knowledge and generally have theories about what 
kinds of assertions are "plausible 11 under different belief 
conditions. In particular, the system must distinguish between 
actions that are plausible to Ft and those that are plausible to 
the actor who may not know that a certain object Is behlrd another, 
etc* 

INFORMATION ftETFtlEVALi 

This field, which addresses a problem of recOgnlied and ever- 
growing Importance, has been dominated up to novr by marglnaHy 
useful attempts to classify knowledge without understanding ft. n 
any particular application* such an "Information retrieval" system 
can be made to do a certain amount of useful screening but as the 
data base expands past the experFmental prototype, one always finds 
a threshold that If set too low Inundate# the user with too much 
hut Tf set higher misses too many relevant Item#, Obviously, one 
can escape thTs only by Increasing the degree to which the system 
Itself tan deal with the meanings of the cl as#IfFcatory concept#* 

A# our v:prk on 1 anguage - understand i ng progresses, we can expect 
more and more areas of application- for such techniques. Our new 
lf mT cro-worl ds" of common'sense reasoning should begin to open up 
the area of Information retrieval to effective applications of 
Artificial Intelligence research* 

We do not have a committment to an V Specific project in this Information 

retrieval area* However, we ere convinced that it Is approaching the 

time when such a study will bp worth while and we plan to discuss Ft 

with others versed in bibliographic and library sciences. 



AREA HE: PROGRAMSFKG 


Workers To Artificial Intelligence havE played important roles in the 
dev# 1 opinedt of many new kFnds of progr a inning languages, As far as our 
own purposes were concern erf* the language situation In our Laboratory 
was, if anythin^, unusually stable over a decade; almost all Al work 
(except, notably, the Greenblatt Chess prog-rap} used LISP as Its basic 
language, and LFSP development Itself was generally conservative. 

However, during this period several sub-1 aneuages were developed within 
the specialist program projects; for example METEOR and CONVERT were 
completed and used in cases where LISP seemed Inadequate. These were 
early pattern directed systems related to CDMIT and SNGBOL and, more 
recently, such Ideas and many others were put together fn Hewitt's 
PLANNER, While the earlier steps in this direction were exploited only 
by their Inventors, PLANNER'S time was evidently ripe, for [t was 
eiirFcfcly adopted for use by Winston’s Vision project, Vfrnograd's Natural 
Language project and several others In our Laboratory. Thus we have 

seen the first major language change Fn a long time. Many other Al 
centers are already working with versions of MfPRO-PLANNER, an 
Implementation of a subset of HewFtt's proposed Targe system, Novr un-der 
deve 1 oprrept, jointly with Project MAC, Is a more comprehensive system 
for PLANNER. In the meantime, experience with MICRO-PLANNER led to a 



react Ion by some users who had 1 difficulties with debugging In situation: 
where PLANNER'S unprecedented facilities for automatic search,, backup, 
and revision of Its own data-structures could pet out of hand and also 
in situations where prof rammers wanted their programs tn have access to 
Information about ju&t whet happened within the automatic searches* 

This led to the proposal of CONNIVER, by Sussman and others, a language 
in which one has many of PLANNER'S spec 1 f i cat ion and automatic 
facI 111Tes but with more control over multiple functional environments, 
return to previous states and explicit control of backup situations. !■ 
nay take quite some time to settle the hatch of new practical and 
theoretical arguments about which assortment of structures and features 
should be given priority in the "general purpose" Al language of the 
near future; In the meantime one Has Tittle choice but to encourage 
experimentation in this area. Vie list below activities bearing on this 
subj ect: 


LANGUAGE DEVELOPMENT: PLANNER 

Jointly with Project MAC. a PLANNER development project is under 
way. There ora quite a few Interesting problems of how to 
implement the new binds of objects and quantities. It Is not an 
ordinary systems programmlng problem. There are serious 
theoretical problems about the extent to which such programs can b- 
compiled, and little is known about what running speeds are 
possible In any case. 

LANGUAGE DEVELOPMENTi CONUlVER 

rprmlvpr permits direct cross communication between different past 
states of a running program. Thus, one can make a suggestion and 
ask how It would have helped in a previous attempt to solve a 
problem! At first sight, the Implementation problems appear 
enormous but many students are thinking about this and we are 
optimistic that 0 system will be built that can efficiently run 
largcr-than-"toy 11 problems. 



LANGUAGE DEVELOPMENT! LOGO 

The language LOGO* fieve 1 oped Tn our Education project, now has an 
incarnation within LISP, developed by i* Goldstein, This brings a 
useful tool Into the ARPANET coirriunity of AI workers, because of 
the rapidly grow Fog body of work in children's cognitive 
development that is involved with the use of thFs language. 

LANGUAGE DEVELOPMENT: LISP 

In essoclatFon with MATHLAB* our version of LISP, MACLISP, has been 
under continue! development* primarily by Jon White and others,, and 
there Fs now a version accessiblE to the AFPA network. 

PROGRAM-UNDERSTAND INfi PROGRAMS: 

Elsewhere In this proposal* wr mention several projects that are 
connected with language develupment, Although not directly 
concerned with new major languages* each has a specialist language 
of Its own and some pf the ideas In them are sure to be demanded 
and Implemented by ethers In one or more of the major exterior 
languages. Particularly promising In thTs regard are the projects 

that are developing programs whleh t understand other programs, 
notably the experiments of Goldstein, Sits smart, McDermott and 

Mewltt, The control structure of Wlnston*s VISION SYSTEM* 
currently written Fn PLANNED, Is also likely to stimulate new 
styles of procedure description, 

THEORY OF PROGRAMMING: 

The AI LAD has played a key role In persuading the computer science 
community to consider more realistic problems; to shift their 
attention from syntactic form to semantic content, Fn programming 
1 anguages this means a move From computer^l i ngy? st its to theory of 
control 1 structures. In mathematical research this means shifting 
from infiriltary logic and recursive function cheery to theories of 
computational complexity* and theory of solvability of control for 
simple problems* Both of these are just as "abstract" and 
theoretical, but far more realistic and practical, 

Indeed, such results from recursion theory as “the unsoTvablUty of 
the halting problem* 1 can be deeply misleading. For an 
"interesting" class of practical programs, knowledge of the 
programmer 1 s Intent, and understanding of common control structures 
Is sufficient to debug a non-halting program. Similarly* In the 
areas of "pattern-reeogn111 pc" and perceptual sciences* we have 
helped to turn the emphasis from 11 1 nvariants" to goal- relevant 
descriptions and* generally, from a wishful-thinking search for the 
Gestalt to the careful analysis of vj-ays In which processes can pass 
from local features to global descriptions and back. In 
heterarchical control structures, 

While we plan to continue working In these areas* Ft Is Impossible 
to predict which iv[ 11 develop next or In which way, While we Stand 



by our judgements about priori ties of importance in this sort of 
theoret 3 ca 1 research, our Laboratory is In damper of becoming 
ineffective In implementing our opinions, for budgetary reasons. 

We cannot afford to recruit enough staff to train tain first-rate 
competence In the necessary areas* We plan to look for add i t i oral 
support In the theoretical area. 

AUTOMAT Ir PROGRAMMING: 

Many of our staff members are working on projects that hear on a 
corrmon problems how to create a computer program that satisfies a 
collection of goal-or)ented cord! t ions— chat is, a program that 
accomplishes a task which Is specified in terms of the result 
rather than ip terms of the computational steps to bp taken. This 
Is true ^automatic pro-gramm! ng" and the possibility of doing it 
resides essentially fn the degree of our ability to represent, 
within the computer appropriate kinds of knowledge about 
computation/ programming, debugging, planning, etc. As the body of 
this proposal shows, our main current goal 3s to develop this kind 
of knowledge and techniques for representing It and we expect that 
this body pf work will lead,. In the not too distant future, to real 
progress toward programme ng systems that can he told what kinds of 
programs are to be produced, 

AREA (V: Education and Prosthetics (Non-ARPA projects] 

EDUCATION: 

To give a rounded picture of the Laboratory 1 ? goals, we have to 
mention some work not supported under the ARPA contract, but 
mutually interdependent with Ft, The largest such activity is a 
program of research Into the structure and development of human 
cognitive skills, with emphasis on developing ways to help people 
learn better how to Eearn, In this area, our Laboratory is working 
on theories originating jointly in Artificial intelligence and in 
the kind of developmental schemata proposed by Piaget and his 
colleagues. We feel that the discoveries we have made In this 
area have been of major importance both ip formulating new Ideas 
about design of superior educational paradigms, ard in helping us 
formulate conjectures about how common sense knowledge may be 
Structured for use in an, artificial Intelligence, 

PROSTHETICS and MOTOR CONTROL! 

A natural result of combining Tdgas about artificial Intelligence, 
robotics, and human profelem-solvlng Is a new horFzon of possible 
ways for men to control external devices. In Instructing a robot 
to do a task, the ordinary industrial technique of recording the 
precise trajectory of a master-slave manipulation system will work 
only in the rigid assembly-11ne situation of absolute task 
repetition. An intelligent helper, on the other band, could do 
much more with an explanation or some meaningful gestures. We are 
planning some studies in which highly handicapped persons might 



control external tystems, such as virtual keyboards or simple but 
versatile manipulators, by using limited motor channels augmented 
by sophisticated I ntent ion-guess: ins software. One irvnerfiate goal 
may be to establish useful channels for Intel Irgent but isolated 
cerebral palsy victims to establish effective re?1 world 
1 interactions* 


Technically, thTs project resembles the AUPA speech program, in the way 
that limited objectives tan have large values in the right situations. 
The scientific deta-Us may also turn out to be rather similar. We plan 

to approach a Health agency for support in this area, and to have this 
activity involve people both In our Robotics and Education groups. 



PAHT J I : 


deepral Theory of rntrl1irente 


Why do we believe that we can ochievp these reals? 

Tt-p complexity of the- answer depends on the dprrF-e of achievement orr 
hjs ir mind, The more immediate appl i to 13 on s are easily seen to he 
"within Che state of the art" set by recent v.’orfc i r. nur Laboratory and 
elsewhere. Th [ s Includes the construction of a working in i n i-robot * 
extending machine vision to some industrial situations, and so on. 

Other aspects of our goals cannot so easily bp justified. Their 
achievement would depend on solving hard theoretical problems* Our 
confidence that this can be done rests on an elaborate theory of 
intelligence that reflects many years of worJc.. in this section we 
review same of the issues in constructing this theory of Tntel 1 i fierce* 
St Is not fully self-contained here and must be read in conjunction wit 
our prorress reports* especially A* I , Mono 252 which Is appended, and 
our previous proposals, 

The form of our review is a brief* almost telegraphic, 
statement of the lines of approach to the problem of 
intnilFfence most common arorg computer scientists. Its 
purpose Is to situate our own position in an intellectual 
landscape that will be familiar to the reader. That is why 
wf will not review the many other, quite different opinions 




held In other disc?pi I nos.. 


AL'MJ HI STRATI VE POWER; 

Jbr secret of Intel If Renee lies In o probTen-solvlrg structure E hat 
rs inherently Mphly efficient and selective, by virtue- of 5 om f 
part icul ar Ty cood schemes for deduction, bookkeep] nic, real-tree 
administration, rrdundancy-c llm? nat Fori, etc. 

LaridAL LTMI F0 FtM I TY: 

The sooret of Intel Hgence lies In using a universal logical 
dec F s1 or procedure. This should be able to handle all sorts of 
problems and not need special prnprammFpp fpr each new kind of 
problem. Of course, one must be able to suitably encode the 
different problems into It along v*1th an adequate set of 
efficiency-enhancing heuristics. 

fWlOr SETJSE; 

One can't expect much "general Intel1Ipence" unless the system 
knows the simplest kinds of things that every normal child does; if 
you move something it will no longer be where It was; two things 
can't be In the same place; if A precedes P and £ precedes C then A 
must precede C; etc. Therefore we first should concentrate on e 
propram with "common sense". This specialist program is essentia) 
for of'rr developments.. 



EPISTEMOLOGICAL PCWER: 


A person seems intelligent because he knows how to dr?l with r 
large variety of problems^ We therefore havr to mn ke col I ret lens 
of such knowledge and to do th F s we first l ave to develop 
systematic schemata for acoulripp* representing ard classify ter all 
the different kinds o knowTedge that will hr needed. 


L FARM!MG; 

1 1 Is Impractical to do all the work Imp Mod by the prtvlous two 
suggest1on$. It would be better to make a general learning program 

that will acquire both common sense and peneral knowledge by trial 
and error* reading books* etc, 

PROG RAMMI Hr K M OW L f P G El 

Perhaps the secret of the general problem solving ability of 
Intel I I pence lies rot in having: enough adequate procedures to 
advance hut in being able to assemble, quickly* a problem solving 
program appropriate to the problem of the momentt This would still 
meat that one needs koowledge* but now It Isn't so genera I/ what 
one needs rs to know enough about programming (and heuristic 
programmIng* |n particular) so that one can write and debug a 
program that Is good enough for the task, 

Before proceeding further* we should summarize our attitude toward these 
viewpoints. There mzy or mey not turn out to be other unsuspected 



general principles of grr at importance, k'e take the pnsUior that aT 3 
the shove points ore relevant but that ore must also 3 dd: 


"fENEFEW. KNOWLEDGE": 


!_■ i T t 


What wf £fe as ''■ ntcl M pence" is a systems ability to 

diffreult problems, in impressively short and effective 
solves a problem in a manner that does rot use 
say that it seems to know how to solve the 
technical reasons,, we cannot Relieve that' 

on a wide variety cf 
a lot of 


d i verse and 
ways. When a system 
tedious search* we must 

0 rob 1 pm. j or various t e unn rcgi reason 5 , w'e 1 
there can c*lst "general" methods to do this 
problems without a lot of stored knowledge, so 

intelligence, on the performance level* must be fn knowing how to 
solve problems pff ic 1 ent 1 y“-and specifically. 


E«OWLEDGE ABOUT KNOWLEDGE: 

On the other hand, for other technical reasons we think that simply 
holding large stores of knowledge Is inadequate, because 
performance will degrade--uni css much of the knowledge fs 
structured to direct the use of the rest. Much of what One knows, 
then, will not appear at the "factual” level at all, but will 
concern when and how to use other parts of the Information store 
and, especially, when not to. 


Although & fijred store of such knowledge could he adequate for a vast 
variety of useful activity, some of it should be concerned v/ i t h k ow t o 
acquire more, so that Intellectual growth Is possible. How much 
know1 edge-structure Fs reeded to begin the "bootstrap” process? We 
don't really know much ahout this. Dor conviction is that one muse be 
very cerefu? in theorizing about the development of intelligence in 
humans, not to overlook the amounts that may he absorbed from the 
environment In highly-prepared abstract form, rn the course of acquiring 
language, Putting aside questions sb-out how the linguistic processes 
themselves ere developed, we believe that even at the level of learning 
proper use of individual words, the child 3 S more or less forced to 



acnuite thousands of Erportant corcepts whose tmportancr h t -;. S rr, 
deterrlred by irlllstlii of forceful sel act I or . 

L b a ve r i D1 me n t i O r P d ms ny o t il a r op Inlflf S h f i 1 d by c rr’D u t c a scientists; 
far example, that perhaps the important advances lip fr parallel 
processinr, or ip holistic access to cor-tent-addresseri memory* ftc. ac. 
Vie have noted only some of the views that May slprlf leant roles ir our 
own models of the situation. 

Sven without attempting t-n decide between ttif-se'-or rather, dfscusslr^ 
the roles that they each play—It should be clear that such a discussion 
presupposes a thorough understand 1np of the issues. Exactly here lies 
the? importance of the relatively deep, if narrow, p*an 1 eat ions of the 
"specialist 11 programs, Both the Vmfih SYSTEM and the fti OTKS WORLD have 
tc 1rJ a /■re at deal, not just about how "perf nrmenc*'- I evel " knowledge 
nljrfct be structured but also about how problem solvers must be 
proerarmnrd , The new wave of DrojrrammFrf methods--PLANNER, CONN! VER--and 
the Heterarchical approach ir funeral, are all attempts to meet problems 
that arose in these studies; fssufs that never clearly crystallised ir. 
the earlier studies on more "general" problem solving systems. 



LFMK l NC 


Hr re egafr there- are a rumber of positions that each shot- or ] v pert of 
the situation. Te common vlrv,' ij ( vr feel, really wrong; that lhrr< 
\ s ? P r C C r s S Cff 1 1 ed lparnirf which I S Ouite d 1st irct f rOr o t h r r n^rti! I 
activities* We list ,& n iff" her of principles that re y seer o h v■ o i 1 s to 
some reefers* and perhaps wrnne to some others. 


DFsnti fmon: 

To record the Important corseque nee s of an experience-, ore must 
extract and represent the essertfal features,. So learning if. rot 
merely r c e o r r 1 1 r r j rt Involves 5 h rewd abstraction, There Is little 
use ir recording everything. 

litmFRSTAWPIWG THE GOAL: 

Ue ought to know the h ird of prpprpe structure vfS went to result, 
before we ten expect Ed be able- to des \ pn a program to le^rn that 
structure. If leemirp then consists of adding axioms £■□ a logic 
data h a 5 e , the learner h p 5 to understand Something about the 
"proof 1 procedure, I f learning consists of makfrg changes In 
programs* thee the learner must know appropriate thlrgs about 

programming. 

U'CRFttFMTAH.TV and CONTEXT-! NDEPENDFNCE: 

Vie want to be ahle to make small changes easily. Adding some thing 
new shovldn^t distort everything learned before * So f nr as 
nosslhle, the lrarnFrg mechanism shouldn’t have tn take into 
account everything else already known; nor should ft have |n know 
all about bow everyth I nr is organized. Dr the surface, at least, 
tb ' s would seerr- to favor use of dec lorotlve statemerts, or 
product f OP“baSed programs. ^ut vre do rot really understand thf 
extent to wh [ c h these mpkr It possible alsn to represent cortrc -1 
S t ryct U re 5 ir ways that am el SO eesily changed incrementally, *rd 
suspect that declarative structures will rot turn out to be very 
P Ciw erfut in this rrpard. 

C'FBlirCIM^! 

Some learning, at least. Is rearranger?rt ard debugging, not just 
addlrg rev/ perfermanco-1cvel krovledre, but rec 1 ass l f y i r| g It, 



rest rueturl PF It, modifying the p rocedti re 5 that pre-res* t;hr 
structures fr which the " f ?ttual u r ni‘.'fflrr- if F-hr^pH. 

[.EAFIMNP TO I. FARM: 

tfr ran't rrs II y expect, after all, to build a prorrm that car Me 
?li these things from the start. t,r the learrFrg protram Itself 
had better he sel f-sopl I rd so that It cen hr boofcst rcpped--by a 
rood teacher. 

Our expe r I pent a 1 and theoretical pro pram must record i tr that 
because we do not yet have sufficiently intelligent pared!pm 
programs, we simply cannot yet frel sure just what Sorts of 
structures wo will want our learning proprams to I earn L That is, 
although we cannot sec any clear ar.d particular difficulty ahead rr 
bull dirs learning programs, wo do not yet know enough to "'specify" 
therr + At the risk of seeming to repeat, it car he put this way: 
vfo st F 11 dp not hsye any prototype programs that exhibit 

satisfactory "common-sense" behavior u&1rg shallow reasoning and 
larre knowledge bases. Not having such a model for a tarpon, we 
are not quite ready to attach directly the problem of learning such 
a structure and still less ready for the problem of "learning to 
I earn" 1t + 

The most promising system for learning at e symbolic description level 
is, at present, the one presented in Winston’s thesis. That system is a 

specialist program; It works at building structural descriptions in the 
hi.prhS h'r'RID by "learning from examples". The baste strategy 1 r this 

scheme is to compare a description of the current situation with certilr 
,r 1 earned descriptions" that It has built up from rarlter experiences. 

The ’'most important 11 differences between the present reel fty and the 
stored paradigms ere computed by a procedure that embodies the mechtoe's 
prejudices about what features of differences between situations are the 
most important. This general scheme raises b lot of specific problems 
for study: 



Understand lop f+i ffr renews . 

The program of kWrStor's thesis builds 3rd rrtfi cf 5 f T f s. dr 5 C r | r t i or S by 
$electln| one “deninan t" feature frrm mcry, fr eech cycle of 
comparing two sE ruetura1 Hescrirtiers, This Is dorr hy a con mo■ - 
sense r a n k r n y of some kinds of relations over others. A rerc 
Irtell Trent way would hr to undrrscard how such features arc really 
related to the current goal; then the System could have "masers" 
for Its rrlerl ties. This wo u I d b f c om r important rxh rr, Ir now 
situations, Ft vfould be shir to re-order these priorities rr r 
rational way, hy reasoning about its reasons* 

Procedural learning. 

V T t h all that wp h a- v e 5 a T d about the Importance of 1 e e r r I r p a r d 
drbuprlng procedures, it would seri" natural to ask about extrndlr-p 
nr adopting the structural desorlption-1 earnIrr prorate to pm pram 
learning. At first jeIppcp, ["'err seems a world of difference 
between describing stacks o f bFoci's and drscri b ire computet tor#] 
schemata. However, Winston's c h antor on " r roup f ry" suyprsts that 
these miFhC not be so far epprt, We see a possible bridge lr the 
transformational process that rFcomlms repeated chains of 
structural relations and re presents them by a nor-rrprt1tive 
structurp dp sc r i b 1 r p thp typical np l pbb-o-rboori of p 1 'typical" 
el creent* 

fuch £ ".rrOup" Structure reSpirb 1 p 5 the Inner loop of a prep ram H The 
abstract fon process Itself seems close to that ore would use to yc ne ro t r 
a closed subroutine to compress parts of an Iterative performance 
protocol Cas proposed, for example, in Hewitt 1972). To m^lce it write 
an actual pros ram One would need, ir principle, only to make Ft add to 

its representation o c ^typical element' 1 information about the IrTtlel 
and final elements as wrl I . For example, the program now describes a 
"stack 11 by dpscriMny a "typical element" ard noting that each typical 
element has another typlral element above lt H To convert this to, say, 
a Prorrem for huiId Fry stacks, one would went to edn pp ir 1 1la 1 1 7 atTen 


sec t1 on: 



"put a block Of the table" 


in nr 1 an ex F t curffitFor: 

"stop i f that block Ts 

Thr "Frner loop" C fr put a block or 
procedure that untferstands how to 
the actFor "out a block or 3t"J 


tV'O fret above thr trblr", 

fcbet block 1 ') WPU 1 d br rorr f £ t prl by a 
make an element "typl cal ri , parsm 1 y, by 


PRf}fiRAMMIHG EPI5TFM01OPY: 

If vfp do tbs t , have we made £ 1 ar^p s tf p toward understan-dinf: 
erouph about p rojt ram -1 earnIrs, or Ts It e miniscule pert of the 
/Ob? To deal with Such £ question - , ore would have to work with a 
claps 1 f loat 1 or of prop rent's true turps, and at least a tentative 
measure of the importance of the different varFetTes. Clearly, one 
can do anything Fn prlrciple, wTth the trIttaltze-loor-exlt 
proprammlrtf element, sFree the exit corriFtior allows the express!or 
of cPrditTopal5, Equally clearly, the loop structure, ip practice, 
is a very confining, FrexpressTve structure for the kFpds. of 
procedures an intelligent system would seen to neef*. 

PR <?C Ft AM Mik’C a nH PLANNING: 

The Issue of how to represent abstractF y, the protocol of an 
experience, is complicated by boy; representations irterser with 
various kinds of poals. For example, ore mipht ask for proposals 
about how a machine mipht have learned the processes that are 
preprogrammed Fnto the prob! om-sol v i np substructure of WF pop red's 
BLOCKS WORLD, 

Consider just the part of the system that removes all blocks or top of t 
block that the prop ram wants to move. 


1. One mlpht have a process Tr y^hlch the machine solves e particular 

case art! then peroral lzes. if several blocks are removed, and the 
protocol of actions is analysed, it would not be hard tc dftect the 
repetition and represent it as a loop. 



2. In PLANNER cede, however, there is no loop, Onr might instead 
recognize in the protocol the bos 1-subgoal -act ion relation of 
removing the supported 1 block, and embed this In an antecedent 
theorem. Here, the generalization is easy, ever from a single 
Instant*; what is harder Is to see how to no tree the significance 
of the repetition; Tn other cases the oro^e^amplt generalization 
will usually be wrong! 

J, In any case, the problem remains of generating a procedure 

appropriate to the goals. The CLEARTD* 1 program is appropriate only 
under certain conditions. if there arc a great many blocks on the 
on* we want to move, then CLEAKTDR wilt involve a lot of work. TFf 
system should be able to learn that this may bn a condition for 
backing up to another goal; It should perhaps he able to use 
knowledge about sweeping all the hlocks off with a broom; It 
should perhaps know about lifting the lower block and dumping them 
off fand this may necessitate some common sense about the 
randomness of where they may land}, 

h. We might realTy want to know how many blocks am OP the One to be 

moved, so this kind of observation might have to be programmed In, 
What kind of knowledge Is required to judge when counting Is 
appropriate? 

For some time, Ferald Sussman has been attempting to formulate the 
Issues Involved In different ways to look, at the problem. Recently, he 
Fas constructed a program- which ,r lparn$ M programs like the CLEARTOP 
procedure by running simpler programs on examples, detectine "bugs"-- 
E no I dents In which the program does something silly-^and formulating a 
program change that makes It work on that example. It remains to be 
seen whether this approach to '"learning through debugging" can be made 
powerful hy providing it with enough diagnostic description and 
programming knowledge. it is Interesting how Issues arise In such a 
project that resemble problems tn oufte diverse areas of computer 
scler-ee; Issues about multiple processes, management of temporary 
storage, domaIrs of protection {of the results of interacting subgoals). 


e te 



|>RftnftAttS and fP'TENTlOMS: 

A direct attack on the problem of rerrescr11 r-r. kr-ov.-1 edge about 
programmrnK F s under way Tn the work of l ra r-ol dstn Fr, who Is 
developFng a system that understands shiff structurri of programs 
that produce graphical drawings. This project i s interesting 
because Tt eombEneS general knowledge shout programs “loop 
structures, recursions, etc. with a semantic basis ir p.vvsrft ry--an 
area that we have always found particularly reriurffint because of 
the deep mathematical techm roues that are close to the surface of 
Such activities.. Goldstein's program attempts to relate the 
expressed Fntertion of the propr?mrer--for example, a child who has 
written a buggEd LOCO program intended tn draw a figure of some 
specified klnd--to the code he has written Ft locks for clues 
about varFous k F nds of familiar programming structures and should 
he able to debug the programmer's code even when the actual code Is 
hopelessly flawed. Such £ program must handle a variety of 
different kinds of know 1 edge *. 
about procedures 
about geometry 

about pretures and must explore how declarative dpscr1pt1ons 
of scenes relate to procedural drawing programs. 



